Decentralized Load Balancing in Heterogeneous Systems Using Diffusion Approach

The grid and cluster computing uses interconnected nodes to solve a problem in parallel in order to improve the response time of the system. Diffusive load balancing algorithms works well when the nodes in the system have the same processing capacity. But little attention was paid in diffusion load balancing algorithms in the literature for distributing the workload in the nodes with different processing capabilities when the load of the nodes is treated as integers. When the loads are distributed to the nodes without considering their processing capacities it would affect the response time of the system. Effective load balancing in heterogeneity can be achieved by considering the processing capacities of the nodes. This paper propose a diffusive load balancing algorithm which distributes a proportion of excessive workload of heavily loaded node to lightly loaded node by considering the nodes processing capabilities.